"Robots.txt File Management"
It will help you to dynamically manage the content of robots.txt in your odoo site.